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(54) Information storage medium containing information for providing multi-language markup 
document, apparatus and method for reproducing thereof 



(57) An information storage medium (300) contain- 
ing multi-language markup document information, and 
an apparatus and a method for reproducing the infor- 
mation storage medium are provided. The provided in- 
formation storage medium includes audio/video (AV) 
data, multiple markup documents which contain text in- 
formation to be displayed in a selected language, which 



is inserted when AV data decoded and reproduced as 
an AV data stream is displayed, and multi-language 
markup document information for being referred to in or- 
der to display a markup document in the selected lan- 
guage. Accordingly, the information storage medium 
displays the text information included in the markup doc- 
ument in the interactive mode in multiple languages. 
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Description 

[0001 ] The present invention relates to an information 
storage medium, a reproducing apparatus, and a repro- 
ducing method, and more particularly, but not exclusive- 5 
ly, to an interactive information storage medium contain- 
ing multi-language markup document support informa- 
tion which is provided together with a reproduced data 
stream displayed in a display window defined by a 
markup document, and an apparatus and a method for 
reproducing the information on the storage medium. 

[0002] A proposed interactive DVD medium in the cur- 
rent market (e.g., PC Friendly DVD disc) can be repro- 
duced in an interactive mode based on a PC (Personal 
Computer). The interactive DVD medium contains 
markup language documents and AV (audio/video) Da- 
ta. AV data recorded on the interactive DVD medium is 
reproduced as an AV data stream and displayed in two 
ways: in a video mode or an interactive mode. In the 
video mode, AV data is displayed in the same way as it 
is displayed on regular DVD players while in the inter- 
active mode, AV data is displayed together with an 
HTML document in a display window defined by the 
HTML document. If the interactive mode is selected by 
a user, a web browser installed in a PC (Personal Com- 
puter) displays the HTML document recorded on the in- 
teractive DVD medium. The AV data related to the HTML 
document is reproduced and displayed in the display 
window defined by the HTML document. 

[0003] For example, in the case of a movie whose 
content is the AV data, a video is played in the display 
window defined by the HTML document, and in the re- 
maining part of the display screen, a variety of supple- 
mentary information including scripts, stories, and pho- 
tos of actors and actresses can be displayed. The sup- 
plementary information may be displayed in synchroni- 
zation with a title (AV data). For example, when an actor 
is on stage, an HTML document containing his brief his- 
tory is invoked and displayed together with his video. 
[0004] An existing DVD-video standard defines sub- 
picture data that provides a multi-language captioning 
together with the reproduced title. Therefore, the user 
can enjoy captions in a desired language when watching 
a program. 

However, the proposed interactive DVD is disadvanta- 
geous in that it allows text-based supplementary infor- 
mation to be displayed in only one language, together 
with the AV data in the interactive mode. That is, the 
proposed interactive DVD does not have the capability 
to present the supplementary information displayed 
through the HTML document in multiple languages. 
Therefore, a user cannot understand text-based infor- 
mation displayed through the HTML document in a lan- 
guage that is foreign to the user. As a result, the inter- 
active mode provided by the interactive DVD is not at- 
tractive to the user. 

[0005] It is an aim of preferred embodiments of the 
present invention to provide an information storage me- 



dium for providing text information displayed through a 
markup document in an interactive mode in multiple lan- 
guages, and an apparatus and a method for reproducing 
the information on the storage medium. 

[0006] According to the present invention in a first as- 
pect, there is provided, an information storage medium 
comprising audioArideo (AV) data, multiple markup doc- 
uments which contain text information on multiple lan- 
guages, respectively, to be displayed in a selected lan- 
guage and defines a display window to display AV data 
decoded and reproduced as an AV data stream, and 
multi-language markup document support information 
for being referred to in order to display a markup docu- 
ment in the selected language. 

[0007] It is preferable that the medium further com- 
prises navigation data on the AV data, wherein the AV 
data is decoded and reproduced as the AV data stream 
with reference to the navigation data. 

[0008] It is preferable that the AV data and the navi- 
gation data are recorded on a video directory while the 
markup documents and the multi-language markup doc- 
ument information are recorded on an interactive direc- 
tory. 

[0009] According to the present invention in a second 
aspect, there is provided, an information storage medi- 
um comprises audio/video (AV) data, sub-picture data 
for providing a multi-language captioning together with 
the reproduced AV data, multiple markup documents 
which contain text information on multiple languages, 
respectively, to be displayed in a selected language with 
regard to the AV data or the sub-picture data, and de- 
fines a display window to display the AV data decoded 
and reproduced as an AV data stream, and multi-lan- 
guage markup document information for being referred 
to in orderto display a markup document in the selected 
language. 

[0010] It is preferable that the medium further com- 
prises navigation data on the AV data and the sub-pic- 
ture data, wherein the AV data and the sub-picture data 
are decoded and reproduced as the AV data stream and 
captioning with reference to the navigation data. 

[0011] It is preferable that the AV data, the sub-picture 
data, and the navigation data are recorded on a video 
directory while the markup documents and the multi-lan- 
guage markup document information are recorded on 
an interactive directory. 

[001 2] It is preferable that the markup documents are 
recorded in multi-language markup document directo- 
ries named by respective language, which are sub-di- 
rectories of the interactive directory, and it is further pref- 
erable that markup documents containing the same 
meaning text information displayed in multiple languag- 
es have the same file name when saved. 

[001 3] It is preferable that the multi-language markup 
document displaying information comprises displayable 
language information that indicates the kind of the dis- 
playable languages recorded on medium, and respec- 
tive language directory information for indicating the 
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path to the markup documents recorded in. It is more 
preferable that language mapping information for map- 
ping a markup document to the selected language is re- 
corded. 

[001 4] According to the present invention in a third as- 5 
pect, there is provided, a reproducing method for repro- 
ducing AV data recorded on an information storage me- 
dium and displaying the AV data in a display window 
defined by a markup document, the reproducing method 
comprising (a) reading a markup document designed to 
be displayed in a selected language for caption, out of 
multiple markup documents that enable text information 
to be displayed in multiple languages, respectively, (b) 
reading and decoding the AV data, and (c) displaying 
the AV data, which has been reproduced, as an AV data 
stream through the read markup document. 

[0015] According to the present invention in a fourth 
aspect, there is provided, a reproducing method for re- 
producing AV data and sub-picture data, which are re- 
corded on an information storage medium, and for dis- 
playing the AV data and the sub-picture data in a display 
window defined by a markup document, the reproducing 
method comprising (a) receiving language information 
on a selected language in order to present captioning, 

(b) identifying the language corresponding to the re- 
ceived language information, and (c) retrieving the 
markup document in the directory corresponding to the 
identified language. 

[0016] It is preferable that step (a) comprises (al) 
identifying a markup document conversion language 
code corresponding to the language code selected for 
caption display by using language mapping information, 
and (a2) invoking the markup document in the directory 
where the identified language code is stored. 

[0017] It is preferable that in step (a2), the markup 
document is stored in the directory that has the same 
name as that of the identified language code is invoked. 
[001 8] According to the present invention in a fifth as- 
pect, there is provided, a reproducing method for repro- 
ducing AV data recorded on an information storage me- 
dium and displaying an AV data stream in a display win- 
dow defined by a markup document, the reproducing 
method comprising (a) reading a markup document de- 
signed to be displayed in a selected language, out of 
markup documents that enable text information to be 
displayed in multiple languages, respectively, (b) read- 
ing and decoding the AV data, and (c) displaying the AV 
data as the AV data stream in a display window. 

[0019] According to the present invention in a sixth 
aspect, there is provided, a reproducing method for re- 
producing AV data recorded on an information storage 
medium and displaying the AV data in a display window 
defined by a markup document, the reproducing method 
comprising (a) receiving information on a selected lan- 
guage in order to display the markup document, (b) 
identifying the language corresponding to the received 
language information, and (c) retrieving the markup doc- 
ument in the directory corresponding to the identified 



language. 

[0020] It is preferable that step (b) comprises (bl ) re- 
trieving the markup document language code corre- 
sponding to the selected language by using language 
mapping Information, and (b2) retrieving and invoking 
the markup document in the directory corresponding to 
the retrieved language code. 

[0021 ] According to the present invention in a seventh 
aspect, there is provided, a reproducing apparatus for 
reproducing AV data recorded on an information storage 
medium and displaying the AV data in a display window 
defined by a markup document, the reproducing device 
comprising a reader for reading necessary data from the 
information storage medium, an AV decoder for decod- 
ing the AV data read by the reader, and an AV blender 
for displaying a markup document decoded by a pres- 
entation engine and an AV data stream reproduced after 
the AV decoder decodes the AV data, in a display win- 
dow defined by a markup document, and a presentation 
engine for interpreting a markup document that has the 
text information to be displayed in a selected language, 
out of multiple markup documents that have text infor- 
mation to be displayed in multiple languages, respec- 
tively. 

[0022] According to the present invention in an eighth 
aspect, there is provided, a reproducing device for re- 
producing AV data and multi-language captioning spe- 
cific sub-picture data, which are recorded on an infor- 
mation storage medium, and for displaying the AV data 
and the captions in a display window defined by a 
markup document, the reproducing device comprising 
a reader for reading necessary data from the information 
storage medium, an AV decoderfor decoding the AV da- 
ta read by the reader, and an AV blender for displaying 
a markup document decoded by a presentation engine, 
AV data and the sub-picture data for caption display, a 
presentation engine for interpreting the markup docu- 
ment recorded in the directory indicated by the received 
language information to be stored in the information to 
display multi-language markup documents, and display- 
ing the AV data stream reproduced after the decoder 
decodes the AV data in the display window defined by 
the markup document. 

[0023] It is preferable that when the markup document 
is displayed in connection with the captions, the pres- 
entation engine refers to the multi-language markup 
document information, retrieves a markup document 
language code corresponding to the language code se- 
lected for the caption display, and retrieves and invokes 
the markup document recorded in the directory which 
the retrieved language code indicates to. If only the 
markup document is displayed, the presentation engine 
refers to the multi-language markup document informa- 
tion and retrieves and invokes the markup document 
stored in the directory corresponding to the selected lan- 
guage by user preference. 

[0024] Further features of the present invention are 
set out in the appended claims. 
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[0025] The above object and advantages of the 
present invention will become more apparent by de- 
scribing in detail preferred embodiments thereof with 
reference to the attached drawings in which: 

FIG. 1 is a block diagram of a reproducing appara- 
tus according to a preferred embodiment of the 
present invention; 

FIG. 2 shows the structure of files in an embodiment 
of a DVD of the present invention; 

FIG. 3 is a diagram of the volume space of the em- 
bodiment of the DVD of the present invention; 

FIG. 4 is a diagram showing the structure of file 
DVD_ENAV.lFO explained in FIGS. 2 and 3; 

FIG. 5 is a detailed structure diagram of an embod- 
iment of multi-language markup document informa- 
tion; 

FIG. 6 shows examples of markup documents re- 
trieved and displayed with reference to the multi- 
language markup document information of FIG. 5; 
FIG. 7 is a flowchart explaining a reproduction 
method according to an embodiment of the present 
Invention; and 

FIG. 8 is a flowchart explaining a reproduction 
method according to another embodiment of the 
present invention. 

[0026] The present invention now will be described 
more fully with reference to the accompanying draw- 
ings, in which preferred embodiments of the invention 
are shown. r A markup document!, in the specification, 
means not only a markup document itself but also a web 
resource that includes files inserted into or linked with 
the markup document. An HTML document means a 
document which is prepared in a mark-up language 
such as XML or SGML and can be interpreted and dis- 
played by the web browser. 

[0027] FIG. 1 is a block diagram of a reproducing ap- 
paratus according to a preferred embodiment of the 
present invention. 

[0028] With reference to FIG. 1 , the reproducing ap- 
paratus decodes AV data recorded on an embodiment 
of a DVD 300 of the present invention and reproduces 
the AV data as an AV data stream. Then, the reproduc- 
ing apparatus displays the AV data in a display window 
defined by a markup document in an interactive mode 
and includes a reader 1, a buffer memory 2, a cache 
memory 3, an AV decoder 4, a presentation engine 5, 
and an AV blender 6. 

[0029] The presentation engine 5 supports the inter- 
active mode. 

[0030] In terms of software, the presentation engine 
5 includes application programs such as a markup doc- 
ument viewer (ex. web browser), a program interpreta- 
tion engine, and a plug-in that interfaces through Appli- 
cation Program Interface (API) with the operating sys- 
tem of the reproducing apparatus. With the API, which 
is a special pre-defined method, the presentation engine 



5 can send a request to the OS and other application 
programs. The program interpretation engine includes 
a JavaScript or a Java interpretation engine. The plug- 
in enables various markup documents to be displayed. 

5 [0031] In terms of hardware, the presentation engine 

5 is set to have a default value on the markup document 
language information of reproducing apparatus, that is, 
the information about the language of the markup doc- 
ument that is displayed when the interactive mode is se- 
io lected. For example, the reproducing apparatus to be 
released in English-speaking nations has markup doc- 
ument language information that commands the selec- 
tion of the markup document having text information in 
English. It is preferable that the markup document lan- 
is guage information varies depending on where the re- 
producing device is marketed or which languages are 
dominant. If a user changes a default value on the 
markup document language information, the markup 
document is displayed in the new selected language or 
20 relevant language. 

[0032] The reader 1 reads the HTML document or the 
AVdata from the DVD 300. The embodiment of the DVD 
300 of the present invention contains a data packet 
where sub-picture data and AV data are multiplexed and 
25 packaged. Therefore, reading the AV data means read- 
ing the sub-picture together with the AV data. However, 
if the user does not select the caption display function, 
the sub-picture data is discarded without being repro- 
duced. The buffer memory 2 buffers the AV data read 
30 by the reader 1. The cache memory 3 caches the 
markup document read by the reader 1 . The AV decoder 
4 decodes the AV data buffered in the buffer memory 2 
and outputs the AV data stream. The presentation en- 
gine 5 interprets the read markup document and identi- 
35 f\es the location of the display window. Then, the AV 
blender 6 displays markup document outputted by the 
presentation engine 5 and the AV data stream outputted 
by the AV decoder 4 in the display window. 

[0033] FIG. 2 shows the structure of files in the em- 
40 bodiment of the DVD 300 of the present invention. 

[0034] The DVD 300 contains multiple markup docu- 
ments having the same meaning content in different lan- 
guages so that text information included in the markup 
documents can be displayed in multiple languages. That 
45 js, the DVD 300 according to the preferred embodiments 
of the present invention includes multiple markup doc- 
uments which contain exactly the same meaning text 
information in multiple languages, respectively. 

[0035] With reference to FIG. 2, a root directory in- 
50 eludes directories VIDEO_TS and DVD_ENAV. The 
VIDEO_TS is a DVD video directory containing the AV 
data, and DVD_ENAV is a DVD interactive directory for 
recording the data including the markup document that 
supports the interactive mode. 

55 [0036] TheVIDEO_TS directory includes VIDEO_TS. 

IFO, VTS_01_0.1FO, VTS_01_0.VOB, and 

VTS_01_1.VOB, .... VIDEO_TS.IFO contains the repro- 
ducing control information (or navigation data) on the 
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entire video title and the language information designat- 
ed as a default value of the video title. In VTS_01_0.IFO, 
the reproducing control information on the first video title 
set is recorded. VTS_01_0.VOB and VTS_01_1.VOB 
are Video Object Set (VOBS) that make up the video 
title set. Each VOB includes video data, audio data, and 
sub-picture data. The sub-picture data is designed to 
display the captions of the movie. More detailed config- 
uration information is included in the DVD-Video Stand- 
ard DVD-Video for Read Only Memory Disc 1.0. 

[0037] The DVD_ENAV directory includes the file 
DVD_ENAV.IFO which contains the reproducing control 
information on the entire title information in interactive 
mode. To be more specific, DVD_ENAV.IFO includes 
the definition and configuration of the relevant directory, 
the number of titles included, basic information, the lan- 
guage used for the title, information on captions and 
fonts, markup document display information such as 
resolution and color, and copyright information. 
DVD_EN AV.I FO further includes multi-language 
markup document information according to the present 
embodiment. The multi-language markup document in- 
formation will be described in detail later. In addition, 
multi-language markup document directories, including 
KOR, JPN, and ENG, are prepared to support languag- 
es of the markup document according to the embodi- 
ment. KOR, JPN, and ENG indicate a Korean Language 
directory, a Japanese Language directory, and an Eng- 
lish Language directory, respectively. Each multi-lan- 
guage markup document directory includes the file A. 
HTM which has the same meaning text information in 
the associated language, and files W.PNG, X.PNG, and 
Y.PNG which are displayed together with A. HTM. Be- 
cause W.PNG, X.PNG, and Y.PNG are the same image, 
they may have the same file name. A Portable Network 
Graphics (PNG) file is a compressed graphic image file. 
Here, it is obvious that an audio file such as an au file 
or an aiff file can be attached to an image file instead of 
the PNG file in another language. 

[0038] FIG. 3 is an outline diagram of the volume 
space of the embodiment of the DVD 300 of the present 
invention. 

[0039] With reference to FIG. 3, the volume space of 
the DVD 300 includes a control information section that 
includes the control information on volume and the file, 
a DVD-video data section that includes a relevant video 
title data, and a DVD-interactive data section that con- 
tains data that supports the interactive mode. 

[0040] The DVD-video data section contains the files 
VIDEO_TS.IFO, VTS_01_0.IFO, VTS_01_0.VOB, 

VTS_01 _1 .VOB, ... that are recorded in DVD_TS, which 
is the DVD video directory of FIG. 2. The DVD-interac- 
tive data section contains the files DVD_ENAV.IFO, A. 
HTM (KOR), A. HTM (JPN), A. HTM (ENG), W.PNG, X. 
PNG, and Y.PNG, which are recorded in DVD_ENAV, 
the DVD interactive directory of FIG. 2. 

[0041] FIG. 4 shows the structure of the file 
DVD_ENAV.IFO explained In FIGS. 2 and 3. 



[0042] With reference to FIG. 4, DVD_ENAV.IFO in- 
cludes the multi-language markup document informa- 
tion according to the present invention. The multi-lan- 
guage markup document information contains informa- 
5 tion on the kind of languages that can be displayed, lan- 
guage mapping information, and information on the di- 
rectory by respective language. 

[0043] FIG. 5 is a detailed structure diagram of an em- 
bodiment of multi-language markup document informa- 
io tion according to the present invention. With reference 
to FIG. 5, the displayable language information included 
in the multi-language markup document information in- 
cludes information on the number of displayable lan- 
guages, the codes of the displayable languages and 
15 whether the languages can be changed during repro- 
duction. 

[0044] The codes of the displayable languages can 
be indicated as ISO-639 language codes. 0x0412, 
0x0411 and 0x0409 are hexadecimal values and indi- 
go cate Korean, Japanese, and English, respectively. 

[0045] In a language mapping table, which contains 
the language mapping information, caption language 
codes are mapped to language codes for mapping to 
relevant HTML documents which are referred to for ex- 
25 tracting the markup documents that contain text infor- 
mation to be displayed in the languages corresponding 
to the caption language codes. To be more specific, the 
captions are displayed in Korean, Japanese, English, or 
Chinese. The markup document displayed with the cap- 
30 tions is displayed in Korean, Japanese, or English. 
Therefore, if the user selects Korean, Japanese, or Eng- 
lish for the captions, the markup document is displayed 
in the corresponding language, Korean, Japanese, or 
English. However, if the user selects Chinese for caption 
35 display, the markup document is displayed in English. 
The number of displayable languages can vary. Even 
when the markup document is displayed without inter- 
working with the captioning, the language mapping table 
can be referred to for extracting the markup document. 
40 For example, if the language of the reproducing appa- 
ratus is set as Chinese (ZH), the presentation engine 5 
displays the markup document prepared in English 
(EN-US) by referring to the language mapping table. 
The information on changeability of markup document 
45 language indicates whether the user can change the 
language during reproduction of the AV data. 0 indicates 
that the language cannot be changed while 1 indicates 
that the language can be changed. 

[0046] The language directory information includes 
so the path names of the multi-language markup document 
directories containing markup documents correspond- 
ing to the displayable language codes, respectively and 
the file name of the HTML document designated as a 
start document file. 

55 [0047] FIG. 6 shows examples of the markup docu- 

ments retrieved and displayed with reference to the mul- 
ti-language markup document information of FIG. 5. 
[0048] FIGS. 6A through 6C show markup documents 
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displayed when Korean captions, Japanese captions, 
and English or Chinese captions are selected, respec- 
tively. In case of Chinese caption, the captions language 
is different from the text information is displayed in the 
markup document. That is, since a multi-language 5 
markup document is supported in the interactive mode, 
embodiments of the present invention can display the 
markup document containing the text information pre- 
pared in the language mapped to the captioning select- 
ed by the user or the language selected by the user. If 
the user changes the Korean captions into Japanese 
captions while a video title is reproduced in the interac- 
tive mode, the markup document displayed together is 
changed from FIG. 6A to FIG. 6B. That is, the present 
embodiment reads and displays A.HTM, the markup 
document, stored in the multi-language markup docu- 
ment directory JPN by referring to the language map- 
ping table and the language directory information shown 
in FIG. 5. 

[0049] If the markup document is displayed without in- 
terworking with the captioning, the markup document 
containing the text information prepared in the language 
selected by the user is displayed even though the cap- 
tion is not displayed. 

[0050] The reproducing method according to a pre- 
ferred embodiment of the invention is described as fol- 
lows. 

[0051] FIG. 7 is a flowchart explaining a reproduction 
method according to the present invention. 

[0052] With reference to FIG. 7, if the interactive-DVD 
300 according to the present invention is inserted into 
the reproducing apparatus, the presentation engine 5 of 
the reproducing apparatus retrieves the language infor- 
mation recorded on VIDEO_TS.IFO and identifies if the 
language designated as a default value of the reproduc- 
ing apparatus exists in step 701 . If the language infor- 
mation recorded on VIDEO_TS.IFO of the interac- 
tive-DVD 300 does not have the language designated 
as the default value of the reproducing apparatus, the 
presentation engine 5 sets the language designated as 
a default value of VIDEO_TS.IFO or DVD.ENAV.IFO of 
the interactive-DVD 300 as the default value for the re- 
production of the markup document in step 702. 

[0053] If the language information recorded in 
VIDEO_TS.IFO of the interactive-DVD 300 has the lan- 
guage designated as the default value of the reproduc- 
ing apparatus, the presentation engine 5 sets the lan- 
guage as the default value for reproduction of the 
markup document in step701 . 

[0054] The reader 1 reads the markup document pre- 
pared in the designated language in step 703. For ex- 
ample, if the Korean language is set as the default value 
for reproduction of the markup document, the reader 1 
reads A.HTM stored in the Korean directory KOR of the 
multi-language markup document directory. The pres- 
entation engine 5 displays the read markup document 
in step 704. 

[0055] If the userchanges the language of the caption 



in step 705, the presentation engine 5 identifies whether 
the languages of the displayed markup documents can 
be changed during reproduction of the AV data by refer- 
ring to the multi-language markup document information 
described above in step 706. If possible, the presenta- 
tion engine retrieves the relevant markup document with 
reference to the multi-language markup document infor- 
mation and the reader 1 reads the retrieved markup doc- 
ument in step 707. The presentation engine 5 displays 
the read markup document in step 708. If the user com- 
pletes the reproduction of the reproducing apparatus, 
the process ends in step 709. If the user changes the 
language of the caption again during the reproduction, 
steps 706 through 708 are repeated. 

[0056] FIG. 8 is a flow chart explaining the reproduc- 
tion method according to another embodiment of the 
present invention. 

[0057] With reference to FIG. 8, if the interactive-DVD 
300 according to the present invention is inserted into 
the reproducing apparatus, the presentation engine 5 of 
the reproducing apparatus retrieves the language infor- 
mation recorded on VIDEO_TS.IFO and identifies if the 
language designated as a default value of the reproduc- 
ing apparatus exists in step 801 . If the language infor- 
mation recorded on the VIDEO_TS.IFO of the interac- 
tive-DVD 300 does not have the language designated 
as the default value of the reproducing device, the pres- 
entation engine 5 sets the language designated as a de- 
fault value of VIDEO_TS.IFO or DVD_ENAV.IFO of the 
interactive-DVD 300 as the default value for the repro- 
duction of the markup document in step 802. 

[0058] If the language information recorded on the 
VIDEO_TS.IFO of the interactive-DVD 300 has the lan- 
guage designated as the default value of the reproduc- 
ing device, the presentation engine sets the language 
as the default value for reproduction of the markup doc- 
ument in step801. 

[0059] The reader 1 reads the markup document pre- 
pared in the designated language in step 803. For ex- 
ample, if the Korean language is set as the default value 
for reproduction of the markup document, the reader 1 
reads A.HTM recorded in the Korean directory KOR of 
the multi-language markup document directory. The 
presentation engine 5 displays the read markup docu- 
ment in step 804. 

[0060] If the user requests the language of the markup 
document to be changed in step 805, the presentation 
engine 5 interprets the multi-language markup docu- 
ment information and identifies if the languages of the 
displayed markup documents can be changed during 
reproduction of the AV data in step 806. If the language 
change is possible, the presentation engine displays a 
menu where the kind of displayable languages that can 
be selected is indicated by referring to the displayable 
language information of the multi-language markup doc- 
ument information in step 807. If the user selects the 
language In step 808, the presentation engine 5 re- 
trieves the relevant markup document by referring to the 
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language directory information (and the language map- 
ping table) and the reader 1 reads the retrieved markup 
document in step B09. The presentation engine 5 dis- 
plays the read markup document in step 81 0. If the user 
completes the reproduction of the reproducing appara- 
tus, the process ends in step 811. If the user requests 
the language of the markup document to be changed 
again during the reproduction, steps 806 through 810 
are repeated. 

[0061] As described above, preferred embodiments 
of the present invention relates to an inf omnation storage 
medium that displays the text information included in the 
markup document in the interactive mode in multiple 
languages and to an apparatus and a method for repro- 
ducing the information storage medium. 

[0062] The reader's attention is directed to ail papers 
and documents which are filed concurrently with or pre- 
vious to this specification in connection with this appli- 
cation and which are open to public inspection with this 
specification, and the contents of all such papers and 
documents are incorporated herein by reference. 
[0063] All of the features disclosed in this specifica- 
tion (including any accompanying claims, abstract and 
drawings), and/or all of the steps of any method or proc- 
ess so disclosed, may be combined in any combination, 
except combinations where at least some of such fea- 
tures and/or steps are mutually exclusive. 

[0064] Each feature disclosed in this specification (in- 
cluding any accompanying claims, abstract and draw- 
ings), may be replaced by alternative features serving 
the same, equivalent or similar purpose, unless ex- 
pressly stated otherwise. Thus, unless expressly stated 
otherwise, each feature disclosed is one example only 
of a generic series of equivalent or similar features. 
[0065] The invention is not restricted to the details of 
the foregoing embodiment(s). The invention extends to 
any novel one, or any novel combination, of the features 
disclosed in this specification (including any accompa- 
nying claims, abstract and drawings), or to any novel 
one, or any novel combination, of the steps of any meth- 
od or process so disclosed. 



Claims 

1. Anil 



2. A medium of claim 1 further comprising: 

navigation data on the AV data, 

5 wherein the AV data is decoded and repro- 

duced as the AV data stream with reference to the 
navigation data. 

A medium of claim 2, wherein the AV data and the 
navigation data are recorded on a video directory 
while the markup documents and the multi-lan- 
guage markup document support information are 
recorded on an interactive directory. 

is 4. An information storage medium comprising: 

audio/video (AV) data; 

sub-picture data for providing a multi-language 
captioning together with the reproduced AV da- 
ta; 

multiple markup documents which contain text 
information on multiple languages, respective- 
ly, to be displayed in a selected language with 
regard to the AV data or the sub-picture data, 
and defines a display window to display the AV 
data decoded and reproduced as an AV data 
stream; and 

multi-language markup document support in- 
formation for being referred to in order to dis- 
play a markup document in the selected lan- 
guage. 

5. A medium of claim 4 further comprising: 

35 navigation data on the AV data and the sub-pic- 

ture data, 

wherein the AV data and the sub-picture data 
are decoded and reproduced as the AV data stream 
40 and captioning with reference to the navigation da- 
ta. 

6. A medium of claim 5, wherein the AV data, the sub- 
picture data, and the navigation data are recorded 



nformation storage medium comprising: 
audio/video (AV) data; 

multiple markup documents which contain text 
information on multiple languages, respective- 50 
ly, to be displayed in a selected language and 
defines a display window to display AV data de- 
coded and reproduced as an AV data stream; 
and 

multi-language markup document support in- 55 
formation for being referred to in order to dis- 
play a markup document in the selected lan- 
guage. 



45 on a video directory while the markup documents 
and the multi-language markup document support 
information are recorded on an interactive directory. 

7. A medium of any one of claims 4 to 6, wherein the 
markup documents are saved in multi-language 
markup document directories created by language, 
which are sub-directories of the interactive directo- 
ry. 

8. A medium of any one of claims 4 to 7, wherein 
markup documents containing the same text infor- 
mation displayed in multiple languages have the 
same file name when saved. 
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9. A medium of claim 6, wherein the multi-language 
markup document support information comprises: 

language selection conversion information for 
mapping a related markup document to the se- 
lected language; and 

language directory information for indicating 
the path to the markup documents. 

10. A medium of claim 9, wherein the multi-language 
support information further includes supportable 
language information that indicates the language 
that can be supported. 

1 1 . A medium of claim 1 0, wherein the supportable lan- 
guage Information includes the information that in- 
dicates whether a language can be converted dur- 
ing reproduction. 

12. A medium of claim 9, wherein the language selec- 
tion conversion information includes a language se- 
lection conversion table where the language select- 
ed for caption display is mapped to a relevant lan- 
guage. 

13. A reproducing method for reproducing AV data re- 
corded on an information storage medium and dis- 
playing the AV data in a display window defined by 
a markup document, the reproducing method com- 
prising: 

(a) reading a markup document designed to be 
displayed in a selected language for caption, 
out of multiple markup documents that enable 
text information to be displayed in multiple lan- 
guages, respectively; 

(b) reading and decoding the AV data; and 

(c) displaying the AV data, which has been re- 
produced, as an AV data stream through the 
read markup document. 

14. A reproducing method for reproducing AV data and 
sub-picture data which presents multi-language 
captioning, which are recorded on an information 
storage medium, and for displaying the AV data and 
the sub-picture data in a display window defined by 
a markup document, the reproducing method com- 
prising: 

(a) receiving language information on a select- 
ed language in order to present captioning; 

(b) identifying the language corresponding to 
the received language information; and 

(c) reading the markup document in the direc- 
tory corresponding to the identified language. 

15. A method of claim 14, wherein step (a) comprises: 



(al ) identifying a markup document conversion 
language code corresponding to the language 
code selected for caption display by using lan- 
guage mapping information; and 
5 (a2) invoking the markup document in the di- 

rectory where the identified language code is 
stored. 

16. A method of claim 15, wherein in step (a2), the 
io markup document stored in the directory that has 

the same name as that of the identified language 
code is invoked. 

17. A reproducing method for reproducing AV data re- 
ts corded on an information storage medium and dis- 
playing an AV data stream in a display window de- 
fined by a markup document, the reproducing meth- 
od comprising: 

20 (a) reading a markup document designed to be 

displayed in a selected language, out of markup 
documents that enable text information to be 
displayed in multiple languages, respectively; 
(b) reading and decoding the AV data; and 
25 (c) displaying the AV data as the AV data 

stream in a display window. 

18. A reproducing method for reproducing AV data re- 
corded on an information storage medium and dis- 

30 playing the AV data in a display window defined by 
a markup document, the reproducing method com- 
prising: 

(a) receiving information on a selected lan- 

35 guage in order to display the markup document; 

(b) retrieving the language corresponding to the 
received language information; and 

(c) retrieving the markup document in the direc- 
tory corresponding to the retrieved language. 

40 

19. A method of claim 18, wherein step (b) comprises: 

(bO) verifying if the language can be converted 
during the reproduction and performing (b) if 
45 language conversion is possible. 

20. A method of claim 19, wherein step (b) comprises: 

(bl) retrieving the markup document conver- 
se) sion language code corresponding to the se- 

lected language by using language mapping in- 
formation; and 

(b 2 ) retrieving and invoking the markup docu- 
ment in the directory corresponding to the re- 
55 trieved language code. 

21. A reproducing apparatus for reproducing AV data 
recorded on an information storage medium and 
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displaying the AV data in a display window defined 
by a markup document, the reproducing device 
comprising: 

a reader for reading necessary data from the 
information storage medium; 
an AV decoder for decoding the AV data read 
by the reader; and 

a presentation engine for displaying an AV data 
stream reproduced after the decoder decodes 
the AV data, in a display window defined by a 
markup document, by interpreting a markup 
document that enables the inserted text infor- 
mation to be displayed in a selected language, 
out of multiple markup documents that enable 
inserted text information to be displayed in mul- 
tiple languages, respectively. 

22. A reproducing device for reproducing AV data and 
sub-picture data which presents multi-language 
captioning, which are recorded on an information 
storage medium, and for displaying the AV data and 
the captions in a display window defined by a 
markup document, the reproducing device compris- 
ing: 

a reader for reading necessary data from the 
information storage medium; 
a decoder for decoding the AV data read by the 
reader; and 

a presentation engine for receiving information 
on a selected language for caption display, in- 
terpreting the markup document stored in the 
directory where the received language informa- 
tion is stored by referring to multi-language 
markup document support information, and dis- 
playing the AV data stream reproduced after 
the decoder decodes the AV data in the display 
window defined by the markup document. 

23. A device of claim 22, wherein the presentation en- 
gine refers to the multi-language markup document 
support information and retrieves and invokes the 
markup document stored in the directory corre- 
sponding to the selected language. 

24. A device of claim 23, wherein the presentation en- 
gine refers to the multi-language markup document 
support information, retrieves a markup document 
conversion language code corresponding to the 
language code selected for the caption display, and 
retrieves and invokes the markup document stored 
in the directory where the retrieved language code 
is stored. 

25. A device of claim 24, wherein the presentation en- 
gine verifies whether the language can be convert- 
ed during the reproduction by referring to the multi- 



language markup document support information 
and retrieves and invokes the markup document if 
language conversion is possible. 

5 26. A device of claim 24, wherein the presentation en- 

gine retrieves and invokes the markup document 
stored in the directory which has the same name as 
that of the retrieved language code. 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



9 




EP 1 288 950 A1 




10 





EP 1 288 950 A1 



FIG. 2 




DIRECTORY 



E 




EP 1 28 8 950 A1 




12 



DISPUTABLE LANGUAGE LANGUAGE DIRECTORY 

LANGUAGE INFORMATION MAPPING INFORMATION INFORMATION 







EP 1 288 950 A1 



FIG. 5 

MULTI-LANGUAGE MARKUP 
DOCUMENT INFORMATION 



DISPLAYABLE LANGUAGE INFORMATION 



INFORMATION 


VALUE 


NUMBER OF 

DISPLAYABLE LANGUAGES 


3 


CODE OF 

DISPLAYABLE LANGUAGES 


0x0412. 0x0411, 0x0409 


CHANGEABILITY OF 
LANGUAGE CONVERSION 
DURING REPRODUCTION 


1 OR 0 



• LANGUAGE MAPPING TABLE 



DVD -VI DEO 
LANGUAGE CODE 


HTML DOCUMENT 
LANGUAGE CODE 


KR(0x041 2) 


KR(0x041 2) 


JP(0x041 1) 


JP(0x041 1) 


EN— US(0x0409) 


EN— US(0x0409) 


ZH(0x0004) 


EN — US(0x04O9) 



• LANGUAGE— DIRECTORY INFORMATION 



CHARACTER CODE 
(ISO-639) 


PATH NAME OF LANGUAGE DIRECTORY 
AND START HTML DOCUMENT 


KR(0x041 2) 


\DVD_ENAV\KOR\A.HTM 


JP(0x041 1 ) 


\DVD_ENAV\JPN\A.HTM 


EN— US(0x0409) 


\DVD_ENAV\ENG\A.HTM 



3 


















EP 1 288 950 A1 



FIG. 6 



(A) KOREAN 




\DVD_ENAV\KOR\A.HTM OUTPUT 



(B) JAPANESE 




\DVD_ENAV\JPN\A.HTM OUTPUT 



(C) ENGLISH 




\DVD_ENAV\ENG\A.HTM OUTPUT 



14 





EP 1 288 950 A1 



FIG. 7 




15 






EP 1 28 8 950 A1 



FIG. 8 



START 



S>75oes LANGUAGE! 
5ESIGNATED IN REPRODUCING 
'^.APPARATUS EXISTS 
DVD2^^ 



-^-1 DESIGNATE DEFAULT 
LANGUAGE OF DVD 



READ MARKUP DOCUMENT PREPARED 
IN DESIGNATED LANGUAGE 

I ~z= 

I DISPLAY READ MARKUP DOCUMENT 



— "DOES USER —■ 
CHANGE LANGUAGE 
n_OF CAPTION?^- 



-""San CHANGE ■ 
LANGUAGE DURING 

REPRODUCTION^ 



ANALYZE MULTI-LANGUAGE 
MARKUP DOCUMENT 
INFORMATION AND DISPLAY 
MENU INDICATING 
SELECTABLE LANGUAGE 



""DID USER^o 
SELECT 

JANGUAGE^- 



READ RETRIEVED 
MARKUP DOCUMENT 



DISPLAY READ 
MARKUP DOCUMENT 



FINISH? 



16 





EPO FORM 1503 03.62 (P04C01) 



EP 1 288 950 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 02 25 4067 



DOCUMENTS CONSIDERED TO BE RELEVANT 




Category 


Citation of document with indication, where appropriate, 


Relevant 


CLASSIFICATION OF THE 


of relevant passages 


to claim 


APPLICATION (IrrtCI.7) 


X 


EP 0 886 276 A (PIONEER ELECTRONIC CORP) 


1,2, 4, 5, 


G11B27/10 




23 December 1998 (1998-12-23) 


13,14, 


G11B27/32 






17,18, 


G11B20/12 






21,22 


G11B19/02 




* column 16, line 40 - column 18, line 10 




G09B5/06 




* 




G06F17/30 




* column 26, line 16 - line 44 * 


J 




Y 




3, 6, 7, 2- 




Y 


EP 0 762 422 A (HITACHI LTD) 
12 March 1997 (1997-03-12) 


3,6,7 ,23 






* column 18, line 35 - column 26, line 20; 
figures 23-28 * 






A 




1.4,13, 

14,18, 

21,22 




A 


US 4 899 292 A (MONTAGNA JOHN A ET AL) 
6 February 1990 (1990-02-06) 


1,4.13. 

14,17, 

18,21,22 






* the whole document * 




TECHNICAL FIELDS 








SEARCHED (lnt.CI.7) 


P, A 


W0 02 05104 A (INTERACTUAL TECHNOLOGIES 


1,2, 4, 5, 


G11B 




INC) 17 January 2002 (2002-01-17) 


13,14, 


G06F 




17.18, 


H04N 






21,22 


G09B 




* the whole document * 






A 


US 6 047 292 A (KELLY ROBERT L ET AL) 
4 April 2000 (2000-04-04) 


1.4,13, 

14,17, 

18,21,22 






* the whole document * 






A 


WO 00 63915 A (SPRUCE TECHNOLOGIES INC) 
26 October 2000 (2000-10-26) 


1.4.13, 

14,17, 

18,21,22 





* the whole document * 






The present search report has been drawn up for alt claims 



Race o< search 

THE HAGUE 


Data erf completion of lhe search 

3 January 2003 


Examiner 

Daalmans* F 


CATEGORY OF CITED DOCUMENTS 


T : theory or principle underlying the invenbon 




E : earlier patent document, but published on. or 


X : parUcularty relevant if taken alone 


after the filing date 




Y : particularly relevant If combined with another D : document cited in the application 


document of the same category 


L : document cited tor other reasons I 


A : technological background 








O : non-written disclosure 


& : member ol the same patent family, corresponding 


P : intermedia® document 


document 





17 




EPO FORM 1503 0102 (PMC01) 



EP 1 288 950 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 02 25 4067 



DOCUMENTS CONSIDERED TO BE RELEVANT 




Category 


Citation of document with indication, where appropriate, 
of relevant passages 


Relevant 
to claim 


CLASSIFICATION OF THE 
APPLICATION (lrrt.CL7> 


A 

A 

A 

P,A 

A 


PATENT ABSTRACTS OF JAPAN 
vol . 1999, no. 11, 

30 September 1999 (1999-09-30) 

-& JP 11 161663 A (TOSHIBA C0RP) , 

18 June 1999 (1999-06-18) 

* abstract * 

-& JP 11 161663 A 
18 June 1999 (1999-06-18) 

* figures 1-4 * 

PATENT ABSTRACTS OF JAPAN 
vol. 2000, no. 09, 

13 October 2000 (2000-10-13) 

-& JP 2000 182359 A (TOSHIBA C0RP;T0SHIBA 
AVE CO LTD) , 30 June 2000 (2000-06- 30) 

* abstract * 

-& US 6 259 858 B1 (ANDO ET AL) 

10 July 2001 (2001-07-10) 

* abstract * 

* column 6, line 31 - line 67 * 

* column 8, line 40 - line 57 * 

* column 10, line 41 - column 12, line 18 

* 

EP 0 863 509 A (TOKYO SHIBAURA ELECTRIC 
CO) 9 September 1998 (1998-09-09) 

* the whole document * 


1,4,13, 

14.17. 
18,21,22 

1,4,13, 

14.17, 
18,21,22 

1,4,13, 

14.17, J 
18,21,22 

1,4,13, 

14.17, 
18,21,22 

1,4,13, 

14.17, J 
18,21,22 




TECHNICAL RELDS 
SEARCHED (tnLCI.7) 




The present search report has been drawn up for all claims 


Place of &eaich Dade ol completion of the search examiner 

THE HAGUE 3 January 2003 Daalmans, F 


CATEGORY OF CITED DOCUMENTS T : theory or principle underlying the invention 

E : earlier patent document, but published on. or 
X : particularly relevant if taken atone after the filing date 

Y • particularly relevant if combi nod with another D : document cited in the application 

document of the same category L : document cited lor other reasons 

A : technological background - 

O : non-written disclosure & : member of the same patent family, corresponding 

P : intermediate document document 



18 



EPO FORM PM59 



EP 1 288 950 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 02 25 4067 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is In no way liable for these particulars which are merely given for the purpose of information. 

03-01-2003 



Patent document 
cited in search report 


Publication 

date 






Patent family 
members) 


Publication 
| date 


EP 0886276 A 


23-12-1998 


JP 


11018048 A 


22-01-1999 






CA 


2241346 A1 


20-12-1998 






EP 


0886276 A2 


23-12-1998 






US 


6434326 B1 


13-08-2002 



EP 0762422 


A 


12-03-1997 


JP 

CN 

EP 

US 


9128408 A 
1146119 A 
0762422 A2 
5909551 A 


16-05-1997 

26-03-1997 

12-03-1997 

01-06-1999 


US 


4899292 


A 


06-02-1990 


NONE 




wo 


0205104 


A 


17-01-2002 


US 


2002088011 A1 


04-O7-2O02 










AU 


7180901 A 


21-01-2002 










wo 


0205104 A1 


17-01-2002 










US 


2002078144 A1 


20-O6-2G02 



US 6047292 A 04-04-2000 NONE 



WO 


0063915 


A 


26-10-2000 


AU 

EP 

WO 


4245300 A 
1171883 A1 
0063915 A1 


02-11-2000 

16-01-2002 

26-10-2000 


JP 


11161663 


A 


18-06-1999 


JP 


3195284 B2 


06-08-2001 


JP 2000182359 


A 


30-06-2000 


US 


2002071657 A1 


13-06-2002 










US 


2002076207 A1 


20-06-2002 










US 


2002136532 A1 


26-O9-20O2 










US 


2002114618 A1 


22-08-2002 










US 


2002159757 A1 


31-10-2002 










US 


2002131766 A1 


19-09-2002 










US 


2002114619 A1 


22-08-2002 










US 


2002136533 A1 


26-09-2002 










US 


2OO2O76208 A1 


20-06-2002 










US 


2002081105 A1 


27-06-2002 










US 


6259858 B1 


10-07-2001 










US 


2001014208 A1 


16-08-2001 


EP 


0863509 


A 


09-09-1998 


EP 


0863509 A1 


09-09-1998 










US 


6345147 B1 


05-02-2002 










JP 


2857118 B2 


10-02-1999 










JP 


9231726 A 


05-09-1997 










wo 


9719451 A1 


29-05-1997 



For more details about this annex : see Official Journal of the European Patent Office, No. 12/02 



19 



